^^622046 


'L-  i 


REPRINTED  FROM 

NflVIll  HEliEflllCH 
LOGISTICS  QWTIliy 

OFFICE  OF  NAVAL  RESEARCH 


NAVSO  P-12 


MiorofiohR 


VOL.  1 1,  NOS.  2A3 


JUNE- 

SEPTEMBER  1964 


DECOMPOSITION  OF  LINEAR  PROGRAMS 
BY  DYNAMIC  PROGRAMMING 


Gnor(e  L.  Neaihauaer 

Tht  Johrtm  Kopkinm  Uni  ve  r  iii  ly 
Bml  limore,  MnryimnJ 


ABSTRACT 

The  decompofition  principle  of  Dantzig  and  Wolfe  ia  a  method  for 
breaking  large  linear  programs  with  a  block  diagonal  structure  into  a 
set  of  smaller  subprograms.  An  alternative  decomposition  scheme 
derived  from  a  dynamic  programming  approach  is  proposed  here.  This 
results  in  a  series  of  parametric  linear  subprograms  whose  recursive 
solution  yields  the  solution  to  the  original  linear  program. 


Dantzig  and  Wolfe  [2,*  3]  have  shown  how  linear  programs  of  the  form 

r 

’'r  *  ““L'j*)' 

subject  to: 


Aj  X|  -f  A2  X2  4-  .  .  .  4-  Aj  Xj  -f  .  .  .  4  A^  ■  b 


AjX, 


^2  ^2 


A,X, 


Xj2  0 

can  be  decomposed  into  a  set  of  linear  subprograms  each  of  which  is  of  considerably  smaller 
size  than  the  original.  In  the  above  Cj  and  Xj  are  vectors  with  Oj  components,  b  and  bj  are 
vectors  with  m  and  components,  respectively,  and  Aj  and  Aj  are  m*nj  and  ma¬ 

trices,  respectively. 


4Sre  Ref.  [Z].  pages  448-469. 
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Using  the  decomposition  principle,  one  solves  r  linear  subprograms  with  constraints 
Aj  Xj  «  bj .  The  objective  functions  for  the  subprograms  are  obtained  from  the  original  objec¬ 
tive  function  and  from  the  coupling  constra.uts  £  Aj  Xj  *  b.  The  overall  problem  is  solved 
iteratively.  That  is,  a  set  of  soluticms  to  the  subprograms,  together  with  the  coupling  con¬ 
straints,  generate  new  objective  functions  for  the  subprograms.  These  are  then  resolved.  The 
iterative  process  is  finite. 

DECOMPOSITION  BY  DYNAMIC  PROGRAMMING 

An  alternative  decomposition  scheme  for  the  above  linear  program  can  be  obtained 
from  a  djrnamic  programming  approach.  It  has  the  advantage  that  each  subprogram  only  need 
be  solved  once.  Each  subprogram  is,  however,  a  parametric  linear  program  in  the  coeffi¬ 
cients  b. 

Consider  a  parametric  linear  subprogram  of  the  original  problem: 


r-1 


1-1 


AjXj  ♦XjX,  ....  +  Xj  Xj  X^_j  .  Yj_j 


A,X, 


^2  *2 


A,X, 


^r-1  *  Vl 


It  can  be  shown  from  the  theory  of  parametric  programming  [4,  THEOREM  ij  that  v^^^  is  a 
piecewise  linear,  concave  function  of  each  component  of  Y^_|.  Thu  places  at  which  v^_| 
changes  slope  correspond  to  values  of  Y^^j  at  which  there  is  a  change  in  basis  required  to 
maintain  primal  feasibility. 

Suppose  that  v^^j  were  known  for  all  values  of  Yj,_j  which  satisfy 


(l:r) 

(2:r) 

*r*r' 

(3:r) 

Then,  from  the  dynamic  programming  principle  of  optinulity  [l,  p.  83j  it  follows  immediately 
that 
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(4:r) 


max 


subject  to  restrictions  (l:r),  (2:r),  and  (3:r).  The  solution  of  Eq.  (4:r)  !.‘equlres  the  maximiza¬ 
tion  of  a  piecewise  linear,  separable  concave  function,  subject  to  linear  constraints.  To  solve 
(4:r)  iib  a  linear  program  the  piecewise  linear  functions  are  replaced  by  smooth  linear  func¬ 
tions,  but  at  the  expense  of  Introducing  an  additional  variable  for  '**'''*'  <n  r!opc  of 

By  using  the  "bounded  variable"  method,  however.  It  Is  possible  to  maintain  the  original  num¬ 
ber  of  basic  variables  [2,  pp.  482-86] . 

Of  course  the  subprogram  from  irtilch  v^^|  ^r-1^  determined  can  be  decomposed  In 
the  same  way  as  the  original  problem.  Applying  this  decomposition  scheme  r  times  we  obtain 
the  necessary  recursion  relations. 


(4:J) 

subject  to 
(1:J) 

(2:J) 

(3:J) 


v,(Y,) 


““  ,(Y  ,)] 

Xj.Y,., 


A,  X,  .  Y,.,  .  Y, 
A,  X,  .  b, 


X.  2  0 


>J  - 


j 


with  Vq  »  0,  Yq  »  0  and  Y^.  *  b. 

Each  of  the  r  successive  linear  programs,  except  the  first,  contains  variables 

and  (mj  4  m)  constraints.  In  each  problem,  however,  additloiial  variables  and  constraints  are 
required  to  take  care  of  the  piecewise  linear  portions  of  the  objective  functions,  though  by 
using  the  bounded  variable  technique  these  will  not  cause  an  enlargement  of  bases.  The  first 
problem  (J  contains  n^  variables,  (m|4m)  constraints,  and  there  are  no  piecewise  linear 
functions. 

For  J  «  1, .  .  . ,  r  -  1,  Yj  are  parameters,  so  a  parametric  linear  programming  algo¬ 
rithm  must  be  used  [4] .  However,  since  Y^  ■  b,  the  lart  maximization  need  not  be  parametric 
unless  a  sensitivity  analysis  on  6  Is  desired. 


EXAMPLE 

Hadley  [5,  pp.  407-411]  has  solved  the  following  linear  program  using  the  decomposi¬ 
tion  principle  of  Oantzlg  and  Wolfe.  It  Is  solved  here  using  the  dynamic  programming  decom¬ 
position  to  compare  this  scheme  with  theirs.  From  this  one  small  example,  however,  it  is 
hardly  possible  to  draw  any  conclusions  as  to  respective  computational  efficiencies. 


Max  X|  4  8X2  4  SXj  4  8x^ 


siibject  to: 


X|  4  4X2  4  Sxj  4  2x^  2  7 
2X|  4  3x2  ^  6 
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X3  ^  4 
^  3 

3X3  *  4x^  ^  12 


Xp  xj,  X3,  x^  s  0 


Let 


Vj(yj)  =  max  Xj  +  8X3 

subject  to: 

xj^4x2^yp  0^yj^7 
2Xj  4  3x3  ^  6 

Xp  X3  2  0. 

This  two-dimensional  parametric  linear  can  be  solved  graphically  to  obtain  X|  -  0,  X3  =  y^/4 
and  *  2yp  0  :<  <  7. 

To  complete  the  solution 


V3  =  max  5X3  +  6x^  ♦  2yj , 

subject  to: 

5X3  -f  2x^  -f  yj  s  7 
Xj  =  4 
x^  s  3 

3X3  4  4x^  >  12 

X3,  Xp  yj  i  0. 

The  solution  to  this  linear  subprogram  is  X3  c  0,  x^  =  3,  y^  =  1,  V3  c  20.  Since  X3  »  yj/4, 
the  optimal  solution  to  the  original  ptoblcm  is  (xp  X3,  X3,  x^)  (0,  1/4,  0,  3). 

CX)NCLUS10N 

For  the  decomposition  scheme  to  be  computationally  effective  the  subprograms  must 
have  considerably  fewer  constraints  and  variables  than  the  original  linear  program.  It  appears 
that  when  there  are  very  few  coupling  constraints  and  a  large  number  of  subprograms  this 
decomposition  algorithm  will  be  most  useful.  But  as  the  number  of  coupling  constraints  in¬ 
creases,  the  method  loses  efficiency  because  of  the  parametric  solutions  required. 

An  important  feature  of  the  dynamic  programming  decomposition  is  the  ease  with  which 
certain  post-optimality  problems  can  be  handled.  If  the  original  problem  Is  modified  by  the 
addition  of  another  subprogram  (Aj.^p  Aj.^p  Cj.^p  the  recursion  analysis  is  extended 

by  the  addition  of  onlv  one  more  parametric  program.  On  the  other  hand,  the  Dantzig-Wolfe 
algorithm  might  require  several  more  iterations. 


I 
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The  theoretical  simplicity  of  the  dynamic  programming  decomposition  leads  to  similar 
schemes  for  decomposing  quadratic  and  convex  programs.  It  is  Interesting  that  this  decom¬ 
position  scheme  shows  how  several  optimization  methods  can  be  synthesized  to  solve  a  large 
optimization  problem.  The  dynamic  programming  approach  decomposes  a  large  linear  pro¬ 
gram  into  a  series  of  parametric  subprograms  and  the  parametric  solutions  lead  to  the  maxi¬ 
mization  of  piecewise  linear  functions  in  the  subsequent  subprograms. 
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